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Abstract. We approach higher-order variational problems of Herglotz type 
from an optimal control point of view. Using optimal control theory, we de¬ 
rive a generalized Euler-Lagrange equation, transversality conditions, DuBois- 
Reymond necessary optimality condition and Noether’s theorem for Herglotz’s 
type higher-order variational problems, valid for piecewise smooth functions. 


1. Introduction. The generalized variational problem proposed by Herglotz in 
1930 [2] can be formulated as follows: 

z(b) —> extr 

with z(t) = L(t,x(t),x(t), z(t)), t€[a,b], (Hi) 

subject to z(a) = 7, 7 £ R. 

The Herglotz variational problem consists in the determination of trajectories x(-) 
subject to some initial condition x(a) = a, a £ R, that extremize (maximize or 
minimize) the value z(b), where L £ C 1 ([a, b\ x R 2m+1 ;R). While in [2] the admis¬ 
sible functions are x(-) £ C 2 ([a, &]; R m ) and z(-) £ C 1 ([a, &]; R), here we consider 
(Hi) in the wider class of functions x(-) £ PC 1 ([a, 6];R m ) and z(-) £ PC 1 ([a, b]; R), 
where the notation PC stands for “piecewise continuous” (for the precise meaning 
of piecewise continuity and piecewise differentiability see, e.g., [3, Sec. 1.1]). 

It is clear to see that Herglotz’s problem (Hi) reduces to the classical fundamental 
problem of the calculus of variations (see, e.g., [12]) if the Lagrangian L does not 
depend on the z variable: if z(t) = L(t,x(t),x(t)), t £ [a, 6], then (Hi) is equivalent 
to the classical variational problem 

f L(t,x(t),x(t))dt —> extr. (1) 

J a 

Herglotz proved that a necessary optimality condition for a pair (x(-),z(-)) to be 
an extremizer of the generalized variational problem (Hi) is given by 


dL_ 

dx 


(t,x(t),x(t),z(t)) 


d dL „ , N N . ., 

f)T BT 

+ (t, x(t),x(t), z(t)) — (t, x(t),x(t),z(t)) 


0 , ( 2 ) 
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t £ [a, b\. The equation (2) is known as the generalized Euler- Lagrange equation. 
Observe that for the classical problem of the calculus of variations (1) one has 
Qfz = 0 and equation (2) reduces to the classical Euler-Lagrange equation 

dL . ...... d dL . 

— (t,x(t),x(t)) - — (t,x(t),x(t)) = 0 . 

In [ 6 ] we have introduced higher-order variational problems of Herglotz type 
and obtained a generalized Euler-Lagrange equation and transversality conditions 
for these problems. In particular, we considered the problem of determining the 
trajectories x(-) such that 

z(b) —>- extr 

with z{t) = L(t, x(t),x(t ),... ,x (n) (f), z(t)), t£[a,b\, (H n ) 

subject to z(a) = 7 , 7 £ R. 

We proved that if a pair (£(•),£(•)) is an extremizer of the higher-order problem 
(H n ), then it satishes the higher-order generalized Euler-Lagrange equation 


^ ’ dP 

3=0 


V> z(t ) 


dL 

dx& 


(x,z) n (t )) = 0 , t£[a,b], 


and the transversality conditions ipj{b) = i/jj{a) = 0, for j = 1 ,..., n, where 

= Er=o (-!) i+1 ^ - j = l,...,n. 

While in [ 6 ] the admissible functions are x(-) £ C 2n ([a, 6 ]; K m ) and z(-) £ C 1 ([a, 6 ]; E) 
here we consider (H n ) in the wider class of functions x(-) £ PC n ([a, b]; R m ) and 
z(-)ePC' 1 ([a, 6 ];M). _ 

One of the most important results in optimal control theory is Pontryagin’s 
maximum principle proved by Pontryagin et al. in [5]. This principle provides 
conditions for optimization problems with differential equations as constraints. The 
maximum principle is still widely used for solving problems of control and other 
problems of dynamic optimization. Moreover, basic necessary optimality conditions 
from classical calculus of variations follow from Pontryagin’s maximum principle. 

One of the problems of optimal control, in Bolza form, is the following one: 

u{-))= J f(t,x(t),u(t))dt + ^(x{b)) —* extr 
subject to x(t) = g(t,x(t),u(t)), 

with some initial condition on x, where / £ C 1 ([a, b] x R m x f}; R), cf> £ M), 

g £ C 1 ([a, b] x R m x f2; R m ), x £ PC 1 ([a, b\; R m ) and u £ PC ([a, b\; Cl), with SlCl r 
an open set. In the literature of optimal control, x and u are frequently called the 
state and control variables, respectively, while is known as the payoff or salvage 
term. Note that the classical problem of the calculus of variations (1) is a particular 
case of problem (P) with (j>(x) = 0, g(t , x,u) = u and fl = R m . In this work we show 
how the results on the higher-order variational problem of Herglotz ( H n ) obtained 
in [ 6 ] can be generalized by using the theory of optimal control. The technique used 
consists in rewriting the generalized higher-order variational problem of Herglotz 
(H n ) as a standard optimal control problem (P), and then to apply available results 
of optimal control theory. For the first-order case we refer the reader to [7]. 
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The paper is organized as follows. In Section 2 we present the necessary con¬ 
cepts and results from optimal control theory: Pontryagin’s maximum principle 
(Theorem 2.1); the DuBois-Reymond condition of optimal control (Theorem 2.3); 
and the Noether theorem of optimal control (Theorem 2.5). Our main results 
are given in Section 3: we extend the higher-order Euler-Lagrange equation and 
the transversality conditions for problem ( H n ) found in [ 6 ] to admissible functions 
x(-) £ PC n ([a, b]; R m ) and z(-) £ PC 1 ([a, b]; R) (Theorem 3.3); we obtain a DuBois- 
Reymond necessary optimality condition for problem ( H n ) (Theorem 3.5); and we 
generalize the Noether theorem to higher-order variational problems of Herglotz 
type (Theorem 3.7). We end with Section 4 of conclusions. 


2. Preliminaries. We begin this section by stating the well known Pontryagin’s 
maximum principle, which is a first-order necessary optimality condition. 

Theorem 2.1 (Pontryagin’s maximum principle for problem (P) [5]). If a pair 
(&(•), u(-)) with x £ PC' 1 ([a, 6];M m ) and u £ PC([a,b\;Q) is a solution to problem 
(P) with the initial condition x(a) = a, a £ R, then there exists ip £ PC 1 ([a, 6 ]; R m ) 
such that the following conditions hold: 

• the optimality condition 


dH 

— (t,x(t),u{t),if(t)) = 0 ; 


the adjoint system 


z(t) = ^(t,x(t),u(t),if(t)) 
^(t) = -^(t,x(t),u{t),if{t))-, 


• and the transversality condition 

tp(b) = grad(<f>(x))(b); 
where the Hamiltonian H is defined by 

H(t, x, u, if) = f{t,x,u) + if ■ g(t,x,u ) 


( 3 ) 


( 4 ) 


( 5 ) 


( 6 ) 


Definition 2.2 (Pontryagin extremal to (P)). A triplet (x(-),u(-),if(-)) with x £ 
PC 1 ([a, b}; R m ), u £ PC ([a, b]; ft) and if £ PC 1 ([a, b]; R m ) is called a Pontryagin 
extremal to problem (P) if it satisfies the optimality condition (3), the adjoint 
system (4) and the transversality condition (5). 

Theorem 2.3 (DuBois-Reymond condition of optimal control [5]). If (x(-), u(-), if(-)) 
is a Pontryagin extremal to problem (P), then the Hamiltonian ( 6 ) satisfies the 
equality 

dH dH 

— (t, x(t),u{t), ip(t)) = — (t, x(t),u{t), if{t)), t £ [a, b\. 

The famous Noether theorem [4] is another fundamental tool of the calculus of 
variations [11], optimal control [ 8 , 9, 10] and modern theoretical physics [1]. It 
states that when an optimal control problem is invariant under a one parameter 
family of transformations, then there exists a corresponding conservation law: an 
expression that is conserved along all the Pontryagin extremals of the problem (see 
[ 8 , 9, 10] and references therein). Here we use Noether’s theorem as found in [ 8 ], 
which is formulated for problems of optimal control in Lagrange form, that is, for 
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problem (P) with <f> = 0. In order to apply the results of [8] to the Bolza problem 
(P), we rewrite it in the following equivalent Lagrange form: 


= [ [f(t,x(t),u(t))+y(t)]dt—> extr, 
J a 


x(t) = g{t,x{t),u(t)), 

y{t) = 0 , 


x(a) = a , y(a) 


<t>{x(b)) 
b — a 


(7) 


Before presenting the Noether theorem for the optimal control problem (P), we 
need to define the concept of invariance. Here we apply the notion of invariance 
found in [8] to the equivalent optimal control problem (7). In Definition 2.4 we use 
the little-o notation. 


Definition 2.4 (Invariance of problem (P) cf. [8]). Let h s be a one-parameter 
family of invertible C 1 maps 

h s :[a,t]xrxO —>Ixl m x R r , 
h s (t,x,u ) = (T s (t, x, u), X s (t, x, u),U S (t, x, u )), 
h°(t,x,u) = (t,x,u) for all ( t,x,u ) S [a, b] x R m x H. 

Problem (P) is said to be invariant under transformations h s if for all (x(-),u(-)) 
the following two conditions hold: 

(i) 


/ O h s (t, x(t),u(t)) + + £s + o(s) 

b — a 


dT s 

dt 


(t,x(t),u{t)) 

= f(t,x(t),u(t)) + ^± (8) 

b — a 


(ii) 


for some constant 


dx s cn~ s 

(t, x(t), u(t)) =go h s {t , x{t),u(t))-jj-(t, x(t), u{t)). 


(9) 


The next result can be easily obtained from the Noether theorem proved by 
Torres in [8] and Pontryagin’s maximum principle (Theorem 2.1). 


Theorem 2.5 (Noether’s theorem for the optimal control problem (P)). If problem 
(P) is invariant in the sense of Definition 2-4, then the quantity 


Cb ~ i)£ + ip(t) ■ X(t, x{t),u(t)) 


H(t,x(t),u{t),ip(t)) 


<Ks(&)) 

b — a 


■T(t,x{t),u(t)) 


is constant in t along every Pontryagin extremal (x(-),u(-),ip(-)) of problem (P), 
where H is defined by (6) and 


T(t,x{t),u(t)) 

X(t,x(t),u(t)) 


dT s 

ds 


(t,x{t),u{t)) 


dX s 

~d7~ 


(t,x(t),u(t)) 


s =0 

s—0 
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3. Main results. We begin by introducing some definitions for the higher-order 
variational problem of Herglotz ( H n ). 

Definition 3.1 (Admissible pair to problem ( H n )). We say that (x(-),z(-)) with 
x(-) G PC n ([a, b\; R m ) and z{-) G PC 1 ([a, b]; R) is an admissible pair to problem 
(H n ) if it satisfies the equation 


z(t) = L(t,x(t),x(t),--- ,x {n \t),z{t)), t G [a, b] , 
with z(a) = 7 G R. 

Definition 3.2 (Extremizer to problem ( H n )). We say that an admissible pair 
(x*(■), z*(■)) is an extremizer to problem (H n ) if z(b) — z*(b) has the same signal 
for all admissible pairs (x(-),z(-)) that satisfy \\z — 2 *||o < e and ||x — x*||o < e for 
some positive real e, where ||y||o = max \y(t)\. 

a<t<b 

We now present a necessary condition for a pair (x(-),z(-)) to be a solution 
(extremizer) to problem ( H n ). The following result generalizes [ 6 ] by considering 
a more general class of functions. To simplify notation, we use the operator (•, -) n , 
n G N, defined by (x,z) n (t) := (t, x(t), x{t ),..., (t), z(t)). When there is no 

possibility of ambiguity, we sometimes suppress arguments. 

Theorem 3.3 (Higher-order Euler-Lagrange equation and transversality conditions 
for problem ( H n )). If ( x{ •), ^(-)) is an extremizer to problem ( H n ) that satisfies the 
inicial conditions 


x(a) = a 0 , ■ • ■ ,a; (n 1 ) (a)=a n _i, a 0 , ■. ■, a„_i G R, (10) 

then the Euler-Lagrange equation 

(Mt)-^(x,z) n (t)\ =0 ( 11 ) 

3 =0 V 7 

holds, for t G [a, b], where 


(ip z (t) = e-tf 

{'‘Pji.t) =Er=o(- 1 ) i+1 S . 3 = 1. 

Moreover, the following transversality conditions hold: 

= 0, j = 1,..., n. (13) 

Proof. Observe that the higher-order problem of Herglotz ( H n ) is a particular case of 
problem (P) when we consider a n + 1 coordinates state variable (xq,xi, .. .x n -i,z) 
with xo = x, x\ — a;, ..., x n _i = a control u = x^ and choose / = 0 and 

<(>(xo,..., x n -i,z) = z. The higher-order problem of Herglotz can now be described 
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as an optimal control problem as follows: 

z(b) — > extr 

'xo (t) = Xi(t), 

±i(t) = x 2 (t), 

X 2 (t) = x 3 (f), 

< ! ( 14 ) 

X n -2 (t) = X n _i (t), 

Xn-1 (t) = U(t), 

J{t) = L(t,X 0 {t),.. .,X n -l(t),u(t),z(t)), 
z(a ) = 7 , 7 G M. 


Observe that since we consider problem (H n ) subject to the initial conditions 
(10), then Xo(a) = ao, ■ • •, x n -\(a) = a n _i with ao, ■ • ■, a„_i given real numbers. 
From Pontryagin’s Maximum Principle for problem (P) (Theorem 2.1) there are 
(t/>i,..., ip n , ij> z ) G PC 1 ([a, 6 ]; R nxm+1 ) such that the following conditions hold: 

• the optimality condition 


— (t,x 0 (t),... ,x„_i (t),u(t),z(t),il} 1 (t),.. = 0, (15) 

• the adjoint system 

ij-i (t) = §S-(t,x 0 (t),... ,x n - 1 (t),u{t),z{t),'il> 1 {t),... ,i(t),i(t)), j = l,...,n 
ipi{t) = xo(t), ■ • •, x n -i (t), u{t),z{t),i> i(f), ip z (t)) 

= -m^&xoit),... ,x„_i(t),u(t), z{t),il)i{t),... ,ip n (t),ip z (t)), j =2,...,n 
Mt) = -|r(Mo (*),--. ,x„_i(t),u(t),2;(t),^i(t),.. .,i/> n (t),^ z (t)) 

(16) 

• the transversality conditions 


= 0) j = l,-..,n, 
= 1 , 


where the Hamiltonian H is defined by 


(17) 


H(t,x 0 ,... ,x n -i,u,z,ipi ,..., Vw 4> z ) 

= Ipi ■ XI + . . . + Ipn -1 • X n —i + tpn ■ U + tp z ■ L(t,X 0 , . . .,X n ~i,U,z). 

Observe that the optimality condition (15) implies that ip n = —ip z §7 and that the 
adjoint system (16) implies that 

U 1 = -^ o , 

S i’j = 1 ^ for j = 2 ,..., n, 

U* = -^§ 7 - 

Hence, ip z is solution of a first-order linear differential equation, which is solved using 
an integrand factor to find that if> z (t) = ke~ ^ -uz dB with k a constant. From the 
last transversality condition in (17), we obtain that k = eJ« H de and, consequently, 
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Note also that for j = n we obtain ip n = — ijj z d j L - , which is equivalent to 


dL 

V'n-l = 37 ( V'zW- ) ^ 4 >. 


dt 


dx r 


dL 

'dx n -l 


By differentiation of the previous expression, we obtain that 


V’n-l = 


dt 2 




dL 


/ dL 
dt \ z dx n _i 


and noting that V’n-i = 2 — a ® L , we find an expression for t/j n - 2 - 


VVi-2 = - 


dt 2 




dL 

dXn. 


Similarly, we obtain that 


d 3 


dt 3 


SL 


^—3 = ITT - 172 [t 


dXn 


dt 2 


d_ 

dt 

dL 

'dx n -i 


i>z 


dL 

dx n -i 


-Tpt 


dL 

dx n —2 




db 

dx n --. 


- tpz 


dL 

dx n - 3 ' 


Applying the same argument to the next multipliers and noting that ip\ = —il >2 — 
we have 

dL 


i>i = - fa 


dx o 


dt n 

or, equivalently, 


<9L 


= (-l)" 3 ^ +(-l) 


dx r 


dt 


— [t 


dL 

' dx n -i 


, dL_ 

dt [^ z dx 1 


(-ir 


dt n 




SL 

9x„. 


(*■ “ 


d_ 

dt 




dL 
dx i 


axo 


dx n —i 

Rewriting previous equation in terms of problem (i/ n ) and in the form of a sum¬ 
mation, one gets 


B-D 

j =0 


, d ] 




dL 


-U 


dP I z dx^L J 


0 


as intended. Observe also that from the previous argumentation we were also able 
to derive expressions for the multipliers: 


n-j 


d* 


* = b-e*? (-* 


i=0 


dL 


'■ dx^ i+ d 


, j = l,...,n, 


which together with (17) leads to the transversality conditions 

n ~j r 




i=0 


dt* 


fa 


dL 


dx^+fi 


= 0, j = 1,... ,n. 


t—b 


This concludes the proof. 


□ 


Definition 3.4 (Extremal to problem ( H n )). We say that an admissible pair 
(x(-), z(-)) is an extremal to problem (H n ) if it satisfies the Euler Lagrange equation 
(11) and the transversality conditions (13). 

Next we present two new important results: the DuBois-Reymond condition and 
the Noether theorem for the higher-order variational problem of Herglotz (H n ). 
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Theorem 3.5 (DuBois-Reymond condition for problem ( H n )). If (x(-), z(-)) is an 
extremal to problem ( H n ), then 

^XV(W) +i/>z(t)L(x,z) n (t) S J = ip z (t)^-{x,z) n (t), 

where tf) z (t ) and ifi(t) are defined in (12). 

Proof. Rewrite ( H n ) as optimal control problem (14) and apply Theorem 2.3. □ 

Definition 3.6 (Invariance for problem ( H n )). Let h s be a one-parameter family 
of invertible C 1 maps h s : [a, b] x R m x R —> R x R m x R, 

h S (t,x(t),z(t)) = (T S (x,z)n(t),X S (x,z)n(t),Z S (x,z)n(t)), 

h°(t, x, z) = ( t, x, z), V(t, x, z) € [a, b] x R m x R. 

Problem ( H n ) is said to be invariant under the transformations h s if for all admis¬ 
sible pairs (*(•), z(-)) the following two conditions hold: 

(i) 

(+£ s + o(s)j z) n (t) = , for some constant £; (18) 

\ 0 CL J CLl 0 CL 

(ii) 


^(X,z) n {t) 


where 

dX s . . . . 

— (»,«)„(*) 

for i = 2 ,..., n. 


( dX s 
T S (x, Z) n (t), X S (X, Z) n {t), ~^{x,z) n {t), . . . 

fjrL-ys \ rj'Ts 

■..,-j^( X ,z) n (t),Z°{x,z) n (t)) -^{X,z) n (t), (19) 

X,z) n (t ) d l X s ft (d{T°y- WW) 

-we and M'TsM &z)*® = -Vi- r7T\ - 

^i-(x,z) n (t) d{T S ) Hr(x,z)n{t) 

( 20 ) 


Next we present the main result of this paper. 

Theorem 3.7 (Noether’s Theorem for problem (H n )). If problem ( H n ) is invariant 
in the sense of Definition 3.6, then the quantity 


V 1pi(t)X i _ 1 (x, Z) n (t) + 1p z {t)Z(x , Z) n (t) 
1=1 


- l^i>i(t)xW(t)+i> z {t)L(x,z) n {t) \ T(x, z) n (t) 


\i= 1 


is constant in t along every extremal to problem ( H n ), where 


CO 

co 

5 ^ 
ii 

h 

"t 

S= 0 

x 0 

dX s 

ds 

8 = 0 

CO 

S3 

II 

N 


-x {l 

’t( 

'dT s 


1 

for 1 = 1,... 

* dt 1 


dt \ 

ds 

8=0/ 


fi>i is defined by ( 12 ) and tp z (t) = %z de . 
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Proof. As before, we deal with problem ( H n ) in its equivalent optimal control form 
(14). We now prove that if problem ( H n ) is invariant in the sense of Definition 3.6, 
then (14) is invariant in the sense of Definition 2.4. First, observe that if (18) holds, 
then ( 8 ) holds for (14) with / = 0 and cj>(x o,... ,x n -i,z) = z. Second, note that 
the control system of (14) defines U s := and X? := d *ff s 1 , that is, 


' dxf 


dt 
dX* 


(x,z) n (t) = X 3 (x,z) n (t)dJ-( x ,z) n {t), i= l,...,n- 1, 


dt 
\ dl~ s 


( 21 ) 

t dt~( X ^ Z )n(t) =U S (x,z)n(t)^ F (x,z) n (t). 

This means that if (19) and (21) hold, then there is also invariance in the sense of 
(9) and problem (14) is invariant in the sense of Definition 2.4. This invariance gives 
conditions to apply Theorem 2.5 to problem (14), which assures that the quantity 


{b - t)£ + ^ <<pi(t)Xi- i(x, Z) n {t) + 1 p z (t)Z(x, z) n (t) 

- 1 pi(t)Xi{t) + 1 p z (t)L(x, z) n (t) + 

b — o 


i=l 


. 2=1 


T(x,z)n(t), 


s—0 


is constant in t along every Pontryagin extremal of prob- 


wher eXi = ^ 
lem (14). This means that the quantity 

(b - t)£ - -j^)1t(x, z)n(t ) + 'S2lp i (t)X i -i(x, z) n (t) + 1 p z (t)Z{x , z) n {t) 
b — a z-— 1 


+ 1 p z (t)L(x, z) n (t) 


. 2=1 


T(x,z) n (t) 


dX“ 


is constant in t along every extremal of problem ( H n ). Observe that Xq = -gj-| g , 
which together with ( 20 ) leads to 


X, = 


d dfX s 


ds d(T s Y 


. d ( d i ~ 1 X e \ 
d ( dt ^ d(T s ) i_1 ) 


s=0 


d d l ~ x X s 


ds \ dll 

dt 


dt \ds d(T s ) 


2—1 


r(0. 


d for s 


s=0/ 

dT s 


dt V ds 


s=0 


s=0 


dt 1 dt V ds 


s =0 


( 22 ) 


To end the proof we only need to prove that the quantity 

(b - f)£ - p^-T(x, z) n (t ) 
o — a 

is a constant. From the invariance condition (18), we know that 

dT s 

(z{b) + £(fc - a)s + o(s)) — (x, z) n (t) = z(b). 

Integrating from a to t we conclude that 

(■ z(b ) + £(b - a)s + o(s)) T s {x, z) n {t) 

= z(b)(t — a) + ( z(b ) + £(6 - a)s + o(s)) T s (x , z) n (a). (23) 
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Differentiating (23) with respect to s, and then putting s = 0, we obtain: 


£{b - a)t + z(b)T(x, z) n (t) = £(b - a)a + z(b)T(x, z) n (a). 
We conclude from (24) that expression (22) is the constant 


( 24 ) 


(b _ _ z{b)T{x,z) n (a) 



□ 


4. Conclusion. We investigated the higher-order variational problem of Herglotz 
from an optimal control point of view. The higher-order generalized Euler-Lagrange 
equation and the transversality conditions proved in [6] were obtained in the wider 
class of piecewise admissible functions. Moreover, we proved two important new 
results: a DuBois-Reymond necessary condition and Noether’s theorem for higher- 
order variational problems of Herglotz type. 
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